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Abstract 

In this paper we extend test set based augmentation methods for integer Unear programs to 
programs with more general convex objective functions. We show existence and computability 
of finite test sets for these wider problem classes by providing an explicit relationship to Graver 
bases. One candidate where this new approach may turn out fruitful is the Quadratic Assignment 
Problem. 

1 Introduction 

Integer linear optimization problems 

(IP)^^ : min{cTz ■.Az = b,ze 

appear in many practical applications. One way to solve such a problem is to start with a feasible 
solution zq and to replace it by another feasible solution z^^v with smaller objective value {^zq — v), 
as long as we find such a vector w G Z" that improves the current feasible solution. If the problem is 
solvable, that is in particular if it is bounded, this augmentation process has to stop (with an optimal 
solution) . 

The key step in this algorithmic scheme, besides finding an initial feasible solution, is to find improving 
vectors. Universal test sets, which depend only on the problem matrix A, provide such vectors for any 
given c and h and for any non-optimal feasible solution zq of (IP)^ f,. Note that universal test sets can 
in fact also be used to find an initial feasible solution zq El- For a survey on all currently known test 
sets for (IP)c J see {12] . 

Graver 4 was the first to introduce a finite universal test set. The Graver basis C?ip(A), or Graver 
test set, associated to A consists of all C-minimal non-zero solutions to Az — 0, where for u,w G Z" 
we say that u □ u if u'-'^u^^' > and ju'-'-' | < \v^-^'> \ for all components j = 1, . . . , n, that is, if u belongs 
to the same orthant as v and its components are not greater in absolute value than the corresponding 
components of v. 
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ExEimple 1. Consider the problem 

minja; + y : x,y & Z+}. 

The Graver test set associated to the problem matrix ^4 = is {±(1, 0), ±(0, 1)}. As one can easily 
check, already the subset {(1,0), (0, 1)} provides an improving direction to any non-optimal solution 
of this particular problem instance. Thus, with the help of {(1,0), (0, 1)}, we can augment any given 
feasible solution to the (in this case unique) optimal solution (0, 0). □ 

Intrinsic to the proofs that there do exist finite (universal) test sets for (IP)^,^ and that they do indeed 
provide an improving direction to any non-optimal feasible solution, is the fact that both the objective 
function and the constraints are linear. Now let us observe what happens with a non-linear objective 
function. 

Example 2. Consider the problem 

min{(x + yf + 4(a; -yf :x,ye 

As again ^ = 0, the corresponding Graver basis is ^ip(^) = {±(1, 0), ±(0, 1)}. However, this universal 
test set for the integer linear program (IP)^, 5 does not provide an improving direction to any non- 
optimal feasible solution for the quadratic problem given above: 

Clearly, (0, 0) is again the unique optimal solution with objective value 0. Now consider the point (1, 1) 
with objective value 4. There are 4 points reachable from (1,1) via the directions given by ftp (A): 
(1,0) and (0,1), both with objective values 5, and (2,1) and (1,2), both with objective values 13. 
Therefore, in order to reach the optimum (0,0) from (1, 1), additional vectors are needed in the test 
set. 

As we will see below, the set Gip{A) U {±(1,1)} provides improving directions to any non-optimal 
solution of the above quadratic problem. Moreover, this property remains true even if we change the 
objective function in a certain way. (For details see below.) For example, with the directions from 
Qip{A) U {±(1, 1)} we can also find the optimum of the following program: 

mm{e\''+y-^\ + A{x - y + 2f + 2x - y: x,y €1+} ^ 

In this paper we relieve the restriction to linear objective functions and employ test set methods for 
the solution of integer optimization problems 

(CIP)^^, : min{/(^) ■.Az = b,z& Z^}, 

where ^ e Z**^", 6 e Z"^, and where 

s 

Herein, c e R", ci, . . . , Cg e Z", cifl, . . . , Cgfl S Z, and /, : M M, i = 1, . . . , s, are Z-convex 
functions with minimum at 0. We call : R ^ M a Z-convex function with minimum at a € Z, if 
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the function g{x + 1) — g{x) is increasing on .t e Z and if g{x + 1) — g{x) < for all integers x < a 
and g(x + 1) — g(x) > for all integers x > a. Clearly, these three conditions imply that x = a is a 
minimum of g over Z. We will, however, restrict our attention to Z-convex functions with minimum 
at 0. This is no restriction, since we can transform any Z-convex function g with minimum at a to 
one with minimum at by considering ^(a;) = g{x + a) instead. 

The problem type (CIP)j f, includes for example linear integer programs for /i = • • • = = 0, or 

quadratic integer programs for fi{x) = x'^ . However, one could apply our approach also to more exotic 
functions as fi{x) = \x\ or fi{x) = —x for x < and fi{x) = for a; > 0, that is, the functions /j 
considered as functions from M to M need not be continuous. 

Our main result is the following. 

Theorem 1.1 Let A G Z''^" and ci,...,Cs € Z" be given. Denote by C the s x n matrix whose 
rows are form,ed by the vectors c{, . . . , cj. Moreover, let Is denote the s x s unit matrix. Then for any 
particular choice 

• of Z-convex functions fi,. . . ,fs with minima at x = 0, 

• of ci^o, • • • , Csfi e Z, and 



provides an improving direction to any non- optimal feasible solution of the problem (C7P)jj,. Herein, 
(pn defines the projection of a vector onto its first n components, and for a set G of vectors 4>n{G) 
denotes the set of images of elements in G under (f)n. 

Trivially, ^ip(A) C Hcip{A,C) for any matrix C. However, as we have seen in Example 2, this 
inclusion can be strict. 

For /i = • • • = = 0, we simply obtain 7icip(^, 0) — Qip{A) as a (universal) test set for (IP)^;,. 
But, as the following example shows, the set Gip{A) gives improving directions even for a far bigger 
problem class. 

Example 3. Consider the family of problems (CIP)^ where ci, . . . , c„ are the unit vectors in M", 
that is, 



• o/cgM", 



the set 




min{/(2;) : Az 



= b,zGZl} 



with 



s 
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As C = J„ , we need to compute the Graver basis of the Lawrence lifting 



( 



A 



) 



of A. Since all elements in the kernel of this Lawrence lifting have the form (m, —u) and since [v, —v) □ 
(u, —u) in Z^" if and only if u □ u in Z", this Graver basis is simply {{u, —u) : u G Qip{A)}. Thus, 
'^Cip(^i^n) = Gip{A), showing that the set Oip{A) is also a test set for this bigger problem class 



Although test set based methods are not yet proven to be successful in practice, there is renewed 
hope from recent work on generating functions ^[3], in which it is proved that in fixed dimension any 
given problem (IP)^ j, can be solved via test sets in time polynomial in the input data. It would be an 
interesting research project to generalize this complexity result to certain classes of functions fi, for 
example to fi{x) = Uix'^^^ with 0;^ > and 7^ G Z+. 

The remainder of this paper is structured as follows: In Section[21we show that our test set approach can 
be applied to convex quadratic optimization problems, of which the Quadratic Assignment Problem 
(QAP) is probably the most famous example. Finally, in Section |3| we prove our main theorem, 
Theorem ll.il 

2 Quadratic Programs 

In this section we deal with the special case of convex quadratic optimization problems 

min{zTQz + c'^ z : Az = b, z e Z" }, 

where Q is a symmetric, positive semi-definite matrix with only rational entries. These problems can 
be solved by the test set approach introduced in Section ^ The reason for this is the following basic 
result from the theory of quadratic forms (8j. 

Lemma 2.1 Let Q G Q"^" be a symmetric matrix. Then there exist a diagonal matrix D G Q"^" 
and an invertible matrix U G Q"^" such that Q = W^DU . Moreover, each diagonal element da of 
D is representable by the quadratic form x'^Qx, that is, for all da there is some xi G R" such that 



Corollary 2.2 Let Q G Q"^" be a symmetric positive semi-definite matrix. Then there exist a diag- 
onal matrix D G Q"^" with only non-negative entries and an invertible matrix U G Q"^" such that 



Proof. This is an immediate consequence of Lemma 12.11 since da = xjQxi > for all i as Q is 



where A is kept fixed and the remaining problem data is allowed to vary. 



□ 




positive semi- definite. 



□ 



4 



Thus, every convex quadratic objective function z^Qz can be restated as X]i=i '^i{^J^Y with > 
and Ci £ Z". Therefore, the test set approach presented in Section ^ is appHcable to these problems 
with fi{x) = aixf, ai > 0. Moreover, we should point out that s < n, that is, the Graver basis that 
has to be computed for TCcip{A, C) involves at most 2n variables. 

In the following, we will restrict our attention to quadratic 0-1 problems. 



Corollary 2.3 Any quadratic 0-1 optimization problem 

mm{z''Qz + c'^ z : Az = b, z e {0, 1}"} 

with symmetric matrix Q G Q"^" can be rephrased as an equivalent problem 

mm{z''Qz + c'' z : Az = b, z e {0, 1}"}, 

where Q G Q"^" is a symmetric, positive definite matrix. 



Proof. As zf — Zi = for z G {0, 1}, the given optimization problem is equivalent to 

min{zTQz + c^z + X{zJIr,z - V z) : Az^b,z e {0, 1}"}, 

where A G M denotes some fixed scalar. As for sufficiently large A = A G Q+ the matrix Q+XIn becomes 
positive definite. Lemma [2. 21 can be applied, giving the result with Q = Q + XIn and c = c — Al. □ 

Consequently, any 0-1 quadratic optimization problem 

mm{z''Qz + c'^ z : Az ^ b, z e {0, 1}"} 

can be written as 

s 

min{^ a^{cjz)^ + c^ z : Az ^ b, z e {0, 1}"} 

with ai > 0, and therefore the test set approach presented in Section ^ can be applied. However, 
choosing different A in the proof of CoroUarv 12.31 we get different equivalent formulations for the 
same problem (CIP)^ j,. But as the following example shows, different problem formulations can lead 
to different test sets Hcip{A,C) for the same problem. These sets, however, are test sets for two 
different problem families of which the given specific problem is a common member. 

Example 4. Consider the quadratic 0-1 problem with A = and 
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Since A = 0, we need to compute the Graver basis of (CI/3). But we have different choices for C. As 
xf — Xi, i — 1, 2, 3, we have 

x^Qx — 2a;ia;2 + 2x1X3 + 4x2X3 

= (xi + X2 + X3)^ + (X2 + X3)^ - ^1 ~ 2X2 ~ 2X3 
= (Xl + X2 + X3)^ + (X2 + X3)^ - Xl - 2X2 - 2X3 



and 

x^Qx — 2xiX2 + 2x1X3 + 4x2X3 

= (xi - 2x2 + xsf + (3x1 + X2 + 4x3)^ + 12(xi - X3)^ - 22xi - bxj - 29x1 

= (xi - 2x2 + x^)'^ + (3x1 +X2+ 4x3)2 + 12(xi - x^f - 22xi - 5x2 - 29x3. 



Therefore, the corresponding two matrices for the test set computations are 







f 1 1 


1— ' 


1 


;) 
















y" 1 


1— ' 








and 



( C" 



h = 





1 


-2 


1 


1 










3 


1 


4 





1 





V 


1 





-1 








1 



Using the software package 4ti2 we obtain 

HcipiA', C) - {(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, -1, 0), (0, 1, -1), (1, 0, -1)} 
Hcip(A", C") = {(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 1, 0), (1, -1, 0), (0, 1, -1), 
(0,1,1), (1,0,1), (1,0,-1), (1,1,-1), (1,1,1), (1,-1,1)} 

Note that 7^cIp(^^ C") C Uciy>{A\ C"). 



□ 



This gives us much freedom to rewrite particular 0-1 problems, possibly arriving at much smaller test 
sets for the same problem. As the following example shows, the same phenomenon happens also in 
the general (non-0-1) case. 

Example 5. Consider the problem with A = Q and 



Q 
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Again, since A ^ 0, we need to compute the Graver basis of {C\Is) for some integer s, and as the 
following shows, we have more than one choice for C: 



2x^ + 2xiX2 + 2xiX3 + 2x2X3 



~ {xi + X2 + .Ta)^ + xl + xl+ xl 

= (xi + X2)'^ + [xi + X^y + {X2 + Xs)'^ 

Corresponding to these two representations are the matrices 



and 



( ^" I ^3 ) 




Using 4ti2 again, we obtain 

Hcip{A',C') 
Hcip(A",C") 



{(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, -1, 0), (0, 1, -1), (1, 0, -1)} 
{(1, 0,0), (0, 1, 0), (0, 0, 1), (1, -1,0), (1,0, -1), (0, 1, -1), 
(1,1,-1), (1,-1,1), (1,-1,-1)} 

Note that again, Hcip(A', C") C Hcip(^", C"). 



□ 



The quadratic assignment problem |2] deals with assigning n facilities to n locations such that a 
certain quadratic cost function is minimized. It can be formulated as the following problem involving 
permutation matrices : 



n n n 



^^^(n XI XI XI '^^jklXijXkl 
i=l j=l k=l 1=1 



EE 

z=l j=l 
n 

E/ ^^-J ~ 



1, ze{i,. 



E^ 



1=1 

x^j e {0, 1}, i,j e {1, 



,n}, 



The value dijki can be seen as costs for assigning facility i to location j and facility k to location I, 
whereas Cij models a fixed cost incurred by locating facility i to location j. 

Even nowadays, QAP's of size n > 30 (that is, with more than only 900 binary variables) are still 
considered to be computationally extremely hard, if not intractable. One major problem in branch- 
and-bound algorithms that try to solve these problems is the lack of sharp lower bounds. 
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As we had seen after Corollary 12. 21 our novel approach presented in Section reduces the question of 
solving the QAP to finding a truncated Graver basis in at most 2?!^ variables, of which variables 
are bounded by 1. 

From a practical perspective, however, we can restrict our attention to certain orthants to find an 
improving vector to a given feasible 0-1 solution. Moreover, we can use the upper bound of 1. Besides 
speeding up the computation, both constraint types reduce drastically the number of test set vectors 
that could provide an improving direction to the current solution, a very important fact for practical 
applicability. 

We think it to be an interesting future project to try our new test set approach to instances from 
the QAPLIB ^U). Although the software package 4ti2 [S] exploits both orthant and upper bound 
constraints, it does not yet include a special 0-1 implementation in which special data structures 
speed up the computation and save valuable memory. 

3 Proof of Main Theorem 

In this section we prove the main theorem. Theorem 11.11 of this paper. First, we will collect some 
facts about Graver bases that will turn out very useful in the final proof. Lemma 3.23 in [7] states the 
following. 

Lemma 3.1 Let B = A a —a ^ be an integer matrix such that the two columns a and —a differ 
only by a sign. Then the Graver basis of B can be constructed from the Graver basis of B' = [ A a 



in the following way: 

gip{B) = {{u, V, w):vw< 0, (w, v-w)€ GwiB')} U {±(0, 1, 1)}. 

A simple corollary of this is 

Corollary 3.2 Let B = ^ A a a ^ be an integer matrix with two identical columns a. Then the 
Graver basis of B can be constructed from the Graver basis of B' = ^ A a ^ in the following way: 

GipiB) = {{u, V, w):vw> 0, {u, v + w) e GipiB')} U {±(0, 1, -1)}. 

Proof. The claim follows immediately from the fact that (m, v, w) is C-minimal in ker ^ A a a ^ 
if and only if (u, v, ~w) is C-minimal in ker A a —a ^ . □ 

The following is an immediate consequence of Lemma l3. II and of Corollarv l3.2l 

Lemma 3.3 Let A G Z''^" and let B — A a ... a —a . . . —a ^ be an integer matrix with 
finitely many multiple columns a and —a which differ only in their signs. Then we have 4>n{Q ip{B)) — 
4>n[Qip[ A a )) U{0}. 
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Proof. The constructions in Lemma l3.ll and in Corollary 13.21 satisfy 4>n (^Gip A a —a = 
(t)n (Gip (a a U {0} and (Gip A a a = (^ip A a )) U {0}. Putting both 
constructions together iteratiyely, we get (t>niGip{B)) = (^Gip A a U {0}, as claimed. □ 



Thus, in order to compute 0„(5ip(-B)), it suffices to compute (f>n yGip \^ A a jj. The following is 
an immediate consequence to Lemma 13.31 

Corollary 3.4 Let A G Z''^", ci, . . . ,Cs G Z", and k G Z>o. Denote by C the s x n matrix whose 
rows are formed by the vectors cj, . . . ,cj, by the bold letter 1 the vector in with all entries 1, and 
by Is the s x s unit matrix. Then 



<l)niGlpiAk)) ^ (l)n{G 



IP 



A 
C L 



U{0}, 



where 



( A 



Ak 



1 1 



-1 1 



V cj -1 1 / 

Before we come to the proof of our main theorem, let us proye two more useful facts. 



Lemma 3.5 Let g be a li-convex function with minimum at 0. Then for fixed p G Z and for fixed 
k > \p\, an optimal solution to 



min{ E (giJ) - gU - + igi-j) ~ gi-j + : 

k k 

P=T,^j-T,y3^ a;j,yj G {0, 1}, j = l,...,fc}, 



is given by 



xi = . . . ^ Xp = 1, Xp+i = . . . = xk = yi = ■ ■ ■ = Vk = 0, if P> 0, 
xi ^ . . . = Xk = yi = ■ ■ ■ = Vk = 0, if p^O, 

J/i = • ■ • = y-p = 1, y-p+i = . . . = 2/fc = xi = . . . = Xfc = 0, if p <0. 

The optimal value in each of these three cases is g{p) — g(0). 

Proof. The case p is trivial and the optimal objectiye yalue is = g{Q) — 5(0). 

Let us now consider the case p > 0. Clearly, since p > 0, some Xi must be positive. Suppose that in 
a minimal solution we have Xi — 1 and j/j = 1 for some i and some j. This cannot happen, since by 
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putting Xi = and yj = we would arrive at a solution with smaller objective value, as all coefficients 
in the objective function are positive. Thus, in a minimal solution yi = . . . — yk — 0. 

Since g is a Z-convex function with minimum at 0, the coefficients g{j) — g(j — 1) in the objective 
function are non- negative and form an increasing sequence as j > increases. Thus, X\ = . . . = x^, = \, 
Xpj^i — . . . — Xk — ^ leads to a minimal objective value. This value is 

E(50)-.90-1))=.9(P)-5(0). 

For the case p < we conclude analogously that xi = . . . = = 0. Moreover, since g is a Z- 
convex function with minimum at 0, the coefficients g{—j) — g{—j + 1) in the objective function 
are non-negative and form an increasing sequence as j > increases. As above, this implies that 
yi — . . . — y-p = 1, y-p+i — . . . — yk — leads to a minimal objective value. This value is again 

-p 

Y.(9i-j) - 9i-j + ^)) = 9{p) - m 

and the claim is proved. □ 

Lemma 3.6 Let fi, ■ ■ ■ , fs be "L-convex functions with minimum at Q, A E Z''^", h E , c G M", 
ci, . . . , Cs e Z", and ci,o, ■ . • , Cs.q £ T, he given. Then for fixed z G Z" and for fixed k > maxljcjz + 
Ci, oil « = !,..., s}, the optimal value of 

min{i: E - f,{j - l))x,,, + - f,{-j + + cJ z : 

2=1 J=l 

Az = b, z e Zl, 

k k 



IS 



/(^) - E where 



i=l 



f{z) ■■^^f^{clz + C^fi)+C^Z. 
i=l 

Proof. Since z is fixed, the problem decomposes into s smaller problems for which we can apply 
Lemma I3. 51 Thus, the optimal value of the given problem is 

s s s s 

Y}f2{clz + Q,o) - fM] + = E + c^o) +c'z~Y. /'(O) = /(^) - E (0)- 

□ 
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Now let us finally prove our main theorem, Theorem ll.il introduced in Section ^ 

Proof. In order to prove this claim, assume that we are given Z-convex functions fi, . . . , fs with 
minimum at 0, ci^, . . . ,Csfi G Z, b G Z"^, and c G M". Moreover, assume that we are given a non- 
optimal feasible solution zq to Az = b, z E Z" . 

The theorem is proved if we can find some vector t G TiciP C) such that zq — t is feasible and such 
that /(zq — t) < f{zo). In the following, we construct such a vector t. 

Since we assume zq to be non- minimal, there exists some better feasible solution zi, say. Let 

k := max{|cJzo + Ci,o|, \cj zi + Ci,oM = 1: • ■ • i 
and consider the auxiliary integer linear program 



(AIP) : min{ ^ ^ - Mj - l))x,., + {f,{-j) - + l))y,,, + cJ z 



i=ij=i 



Az 



cj z + Ci.o — X, 
Xi,j,yi,j G {0,1}, 



fc 



z G Z';, 

z = 1,.., 



,k]. 



By Lemmas 13 . 51 and 13 . 61 the minimal values of (AIP) for fixed z — zq and z = zi are /(zq) ~ /o 

s 

/(zi) — /o, where /o = /i(0)- By (zq, xo,yo) and (zi, a;i, j/i) denote feasible solutions of (AIP) that 

1=1 

achieve these values. 

As /(zq) > /(zi) by assumption, we have /(zq) — /o > /(-^i) ^ /o- Thus, (zo,xo,yo) is a feasible 
solution of (AIP) that is not optimal. Therefore, there must exist some vector (t, u, v) in the Graver 
basis associated with the problem matrix of (AIP) that improves (zq, xq, j/o)- We will now show that 
t G 7icip(^, C*), that Zq — i is feasible for (ClP)y. and that /(zq ~t) < /{zq). The claim then follows 
immediately. 

The problem matrix associated to (AIP) is 



A, 



\ 



1 1 



1 1 



where 



(f>n{Glp{Ak)) = GlP 



A 
C L 



1 1 / 



U{0}^Hcip{A,C)U{0}, 



by Corollarv l3.4l Therefore, (t, u, v) G Gip{Ak) satisfies t G Hcip{A, C)U{0}. Moreover, as (zq, a;o, j/o) — 
{t, u, v) is feasible for (AIP), we must have A{zq — t) = b and zq — < > 0, implying that z^ — t is feasible 
for (CIP)^.,. 
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It remains to show f{zo — t) < /{zq), since this also impHes t ^ and hence t £ 7icip(^, C)- 
Let [zQ—t, a;2, j/2) be a feasible solution of (AIP) that achieves the minimal value f{zo — t) — fo of (AIP) 
for fixed z = zq — see Lemmas 13.51 and 13.61 for its existence and construction. Clearly, this minimal 
objective value for fixed z = zq —t is less than or equal to the objective value of (zq, xo,yo) — {t, u, v), 
which in turn is strictly less than f{zo) — fo, the objective value of (zo, xq, yo)- 

Therefore, /(zq - - /o < f{zo) - /o and consequently /(zq ~ t) - /(zq). □ 

Acknowledgment. The author would like to thank Kristcn Nairn for many helpful comments on 
this paper. 
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